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LKTTEK OK TUANSMHTAL 


^ Df.pahtmrxt of thf- Tntfrior, 

BLiiFAi' of Education, 
WaHhin(jton. Jdnuarif JlK 1927. 

Sir:. This bulletin is the secon<l of a cooperative series sponsored' 
by (he National Omimittec on Research in Secondary Education, 
With the profession of education demanding research as a basis for 
adaptation of school ])rocednrcs. research is being undertaken by an 
increasing number of agencies and is rapidly involving school prin- 
cipals and classroom teachers. The Bureau of Education regards 
this tendency ns Avholesonie and is seeding to encourage it by lending 
its fadlities for research to educational organizations.' 

* It is believed that this bulletin will prove helpful to high-school 
]>rincipal.s and teachers ^\ho wish to undertake research coHcerning 
their problems and will encourage them to undertake research. 

Jno. J. Tiorrt, fH ^ imisgioncr . 

The Sec»et.\rt of thb Interior. 
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AN OUTLINE OF METHODS OF RESEARCH 


WITH SUGGESTIONS FOR HJGH-SCHOOL PRINCIPALS AND TEACHERS 

. ' — i 

I. INTRODUCTION " 

\. The need fbr educational research . — One of the most persistent 
criticisms of education as a science is that it is based too largely on 
speculative philosoi>hy: it is a matter of opinion, of trial and error, 
of personal judgment, whore one man’s opinion is considered ns good 
us another's. Conse<iuently, tlu* business man. the parent, the man on 
the street often feels that his opinion on sc hooh matters is as good as 
that of anyone else. Tlie teacher, the princij)al, the superintendent 
ai’c often looked upon as theorists, with little, if any, understanding 
of life as it really is. This stage in tlie development of education is 
rapidly passing. The fact that it is passing is due largely to the 
\videspread interest in research into educational problems of all kinds. 
Research aims to discover triith; it is not satisfied with a priori 1*60- ’ 
s;oning, nor with subjective judgments, nor with mere spec\dation 
based upon insecure and unproved data,’ Educators everywhere are 
looking for facts, for trutljs upon which to base educational reforms. 
They want to know whether the new method actually brings better 
results, not what^soine advocates think it will do. They warit to 
know whether the 00-niinute suj)ervised study period actually im- 
proves the quality and quantity of the i)upils* achievement as com- 
pared with the old 4.')-minute recitation ))eriod, _and, if so, under 
what circumstances. 

True progress can come only when ways and means of finding facts 
and measuring results are dei^ised. This is especially true of educa- 
tion because it is so comple.\ and the results are so often delved. 
Educators have so long merely “canietl on ”* and followed in the 
footsteps of those that have gone before that they take it for granted 
that the obje<Ttives ^et up are actually accomplished, when they really 
are very much in the dprk about whai is going on and have no 
adequate means of knowing what the results are. ' 

This attitude of mind that relies upon t^dition and. authority, 
combined with the complexity of the problejn/has se^^fed to delay 
the scientific search ^for ‘truth in education. While scientific research 
in eduoation has not progressed very far, at least two things have 
been accomplished ; (1) The importance of the discovery 'of truth 
has been demonstrated, and (2) methods of finding vthe truth have ' 
been partially developed. ' # 


2 , 


AN OUTLINE OF J®TIIODS OF RESEARCH 


ERIC 




2. The teacher as a research worker . — Up to the present time 
educational research, in common with other forms of truth finding,’ 
has been confined largjely to 'tho laboratory, to ^ places where data 
could be assembled, dissected, and analyzed apart from the school- 
room, and certain conclusions reached that were sent back to the 
schoolroom ^ for use. In the psychological laboratory various ex- 
periments have been nnule to find what niethad of memorizing is the 
most etfeclive. The results showed that the method of nioiuorizing 
V a selection as a whole was much more effective than the old one of 
learning it in parts. The expert comes to the school and obtains^ 
certain facts about attendance, costs, methods of in.struction, teachers, 
etc. He takes these to his xvorkroom, his laboratory, analyzes them, 
and makes his recommendations for improvements. This will 
always. remain a very’ important part of the machinery of research 
in education. Certain problems can best be investigated in a place 
apart where conditions can be absolutely-controlled. Every school 
system should have access to such an agency. T’he rapid develop- 
ment of Bureaus of Ediicational Research in our large cities and in 
many of the teacher-training institutions shows that the ‘importance 
of this service is now btung recognized. 

Hut helpful and indispensable ns laborafory research is. by its 
very isolation it can not carry on certain types of investigation, nor 
roach Valid conclu.sions regarding nlLdonds of schoolroom practices. 
Of necessity’ these laboratory expeiin\mts are usually performed on 
Selected groups, often of adults, and u^t^^aterial unlike that em- 
ploy’ed in the classroom in which the pajrticular element under 
investigation is to be found. Data takeh'away from the school by 
tho expert arc analyzed out of relation to actHal conditions of the - 
classroom. Much research 'can be carried on ouhf-^ the classroom 
where the process of education is actiinlhj taking pt-aee, where the 
conditions, arc normal, and where all the agencies concerned are 
funetioning as they usually do. In if^y ways it is this kind of 
research that prpniises the largest returns for improvement of prac- 
tice. Examples of such research problem.s for the classroom are: 
(1) Whioh of these two methods is more effective in reducing tardi- ' 
ness, keeping in after school those who are tardy or making the first 
})eriod in the- morning very attractive? (2)'AfB* the results in 
actual achievement greater when some time is given to teaching 
pupUs how to study than when they are thrown on their own re- \ 
sources? ^ (3) Do pupils gain appreciably more from five^perio da a_ J 
week than frdm four if the some content and methods are^ used and 
other things are equal ? * 

The t^pcher and the principal, then, become very important factors 
in educational research. In the near future they must assume their 
proi>er share of this responsibility. Principals should develop in 
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themselves an attitude of scientific research toward the problems that 
confront them ami do all in their power to develop the same attitude • 
in their teachers. 

3. <)hntac1e» in th^ iray^oj research hy thf feocher hnd prinripaL— 
There are many obstacles in tire way of l•c.«purch on the part of the 
teacher an<l of the ])rincipal. One of the.se i.s lack of time arid enerpy 
for ihe work. The. teaching load curried l)y teachers is often so 
jrreat a*s to preclude any pr».s.sil)ility of time for research. Principals 
and boards of education arc still too often ob.ses.<<ed by the traditional 
factory point of view. 'Fho teaching loa<l is stated in^ terms of the 
numlM'r of recitations held per day or per week. Vacant periods” 
aro so much lost time, as far as the .scliool is concerned. The prin- 
cipal is often so loa<ietl up with petty duties that could be performed 
as well, and often better, by a secret urv that be has no time to find 
the truth about the .school. 

Probably the frreute.st deterrent to researeb in the .school i.s the 
fact that principals and teachers do noOcnow how to do it. Many 
teachers arc eaf>er to try out some plan, to invest ijrate .some phase 
of school work, b t they do not know how to bearin’, they have no ' 
conception of the difficulties involved nor of the comlitions fliat 
must be established in order to make sure that the tlata are accurate 
and the eonclusion.s valid. Many otherwise splendid investijjations 
inad^ by teachers and principals are made valueless because condi- 
tions e.s.sential to research ure disre<:arded. Unfortunatoly, these 
often find their v^y into reputable edtioational journals, and teachers 
are often confused or led astray l>y conclusions or rocomiutindations 
based tij)on them. ' 

4. The purpotb of this hvUetin , — The purpose of this bulletin is to 
pive definite help to the principal and teacher who wish to investipate 
some phase of secondary school work. The conditions esvsential to 
scientific research will Ik? brieHy stated in lanpiiape as nontechnical 
as possible, and certain types of research problems will- be .briefly 
discussed. Finally, some helps wi41 he given on^^he method of 

- reportinp the results of resea rcluy 

II. THE CONDITIONS ESSENTIAL TO SCIENTIFIC 

RESEARCH 

1. The meaning and purpose of research . — Research is not merely 
a search for truth; it involves a systematic, purposeful search for 
truth. The dilTerenco between looking for truths and research may 
be crudely illustrated hy the'differept methods employed in searching 
for a lost article of any kind. Some persons in attempting to find 
a lost article look here, there, and everywhere with no system and 
no purpose except to find the thing lost. They go upstairs looking 
28018 *’— 27 2 
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ijl the first places that come into their heads, then downstairs, then 
upstairs again, often looking over und over again in the same places. 
They may find the article and often do; they may even find it at 
once; but whether they find it or not is largely due to chance, and 
in the long run inudi time is wasted. Other ijcople confronted witll 
the same situation consider carefully, before they begin to search, 
where the article was used last, who used it, and where it is likidy to 
be. If some jiromising clue i.s ^discovered by tlihs method, search is 
. made fir.st in places indicated. If no clue is- obtained, a systematic 
search is made, beginning in a Vooiii where the arti«de is most likely 
to be found and thoroughly searching this room before going to 
•the next. This is .systematic, purposeful search, using all available 
data to guide the .search, li may be that more time is sometimes 
coasumed in finding the article Ilian under the hapha/.ard method, 
but in the long run it will lii’ing results much inoi-e quickly and, 
surely. Truths have sometimes been discovoretl by accident, btit 
most truth has come to light only after paiastak^ng scairh and in- 
vestigation guided by scientific methods. In Jmapy cases where 
trutlv st*<»ms to have been discovered by accideuit ix has happened 
while the investigator, was carefully and .systematically working on 
one po.ssible solution to hi.s problem, and his mind .was so alert that 
when the right solution happened to appear he recognized it nt 
\ once. 

The ju.stice of the point of view just .stated must b*^dmitted. The 
danger of limiting investigation to tliose elements in education that 
can with our jn-c.scnt facilities be objectively measured must ‘be 
clearly recognized. Ackno\> letlgment should he made %iat mere 
hypothj^sis -is valuable even though it may leave to the futm-e the 
~ problem of veritication. The conelusion mu.st bo acaqited that the 
statistical treatment, mere manipulation of figures, may utterly fail 
to achieve the desired result; it may serve to conceal truth or to 
Iwrbor untruth. 

, In many school survoy.s standard achievement tests are ji^en in 
arithmetic and reading. The results of these are expressed in 
numerical terms, averages of these are taken^ and the work of the 
teachers in the school is judged by these averages. This is inade- 
quate and incorrect, because (1) these tests do not measure all the 
valuable re.sults of teaching, and (2) averages obscure the achieve- 
ment of individuafs in th^ group. Furthermore, no account is usu- 
-ally taken of the native ability of the groups measm-ed. With the 
stress now being placed upon differentiated curriculum content to 
suit the varying needs of pupils ii\ different school ^Systeras, standard 
achievement will more and more lose 'their value for any 
I individual schooL 
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On the other hand, the danger of the subjective judgment of an 
inditidual must cleiirly be recognized when it is not supported by 
luleciuale <lata wliioli are tliemselves as largely (ibjective as j)ossibIe. 
While retrognizing the value of hypothesis, it must also be insisted 
(luit, wherever possible, research should at least go as far'as possible 
toward veriHcation of hypothesis. g, 

All sustained, systematic investigation or imiuiry which' seeks facts 
or their ayplicatibn is, (hen, resemcdi. Alth(uigli invefttigations and 
iiupiiries concerning educational procedure arc largely inductivei 
reflective studies that result in new applications of establisluMl prin- 
ciples may be included luuler the term educational research. Any 
testing of educational beliefs or the«uie.s by tlieir cfuisisteney with 
ascertainable faicts is lesean-h. 

2. Renearrh^ o mt'thod , — Keejjing all these points clearly in mind, 
let us see just what research implies. It is. tirst of all, a method .of 
* 'I’lio ilitferciice het well scientific resi'aivli amPanv other 


Turning to the field of cilucation, it mav be .said ; 

Tlib ultliualf iiuriMisf of all eilutalioniil reseurcli Is Uie dl.scover.v of pn)* 
iTilurrs, rule.s, and prlnclplps rolatin]^ tt» the various n<:|i(>c(.s of edurotloa. ' 
Crltlcol, reflei'tive thiakiiiK i.s re<|iiired. in which discovered farts and prliicIpleH 
niuy Ik> ntili‘/.e(l, as well us oriaiaiil data. Thus the aiisweriiiK of nay <iiies(ion 
alHUit odm-^tlon by inoniis of erltlenl rotleetivo thiiikliiR, liiised uiion the “Wat**, 
data ohtaliialilc, may proiH>rly he culled edacutional resoareh.* 

H. The eUmenin in renearch. — Tn general, the stc|)s in research are 
the .same as those in any proce.ss of reasonin«t» They are as follows: 
(1) The fornuiiation of tlio problem; (2) the as.seinbly of relevant 
data; (3) thp critical analysis of data; (4) the development nf an 
hypothesis or possible solution; (5) testing the validity of the. 
hypothesis or verification., These are not to he considere^d aa neces- 
sarily sequcntiffl, but merely' as steps necessary at^ioino point in the 
process of research. t 

It may be well at this imint to call attention to a marked difference 
of opinion regarding educational rc.search. This difference has to do 
largely with the data to be iiseid apd.with the importance of complete 
verification. Some authorities clearly indicate that the" ofAy data 
admissible in research are ohjecti^’e <hita, i*. e., data that can be 
weighed and measured by definite standards and sc 4 »les, and from ' 
which all subjective elements are excluded. They give as examples, 
of this the data that form tlie basis for Jlludies oir the weight and 
height of school children, age-grade classification of pupils,^ achieve- ' 
men^ in reading, writing, and arithmetic measured by standard 
tests. They say that all research should be based upon data of such 

Monroe, W. B., and Johnston, N. B. Keporting educatl research, p. S. 
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nature that anyone else co.uld take them and come to the same or 
similar concfusions. Anything else than this is not research. They 
also affirm that research must verify conclusions. 

Opposed to this are many who contend that all data, even those 
called objective, have their subjective aspects; that purely- subjecfive 
data based upon tlie judgments of teachei's are valuably, often of 
. even greater value than data that seem to be more objective, since 
education involves many elements not yet capable of objective de- 
termination; that opinions of people are legitimate objects of investi- 
gation and are admissible as data. They also affirm that analysis 
and hypothesis arc in themselves research, even without complete 
verification,' They point out the fact that many of our most valu- 
able scientific truths and laws have been the result merely of analy- 
sis, of deductive reasoning based upon knowit truths, reasoning that 
has gone no furtlier than hypothesis: for example, the research into 
differentiated content or method for differing ability groups. 

• Tliis may be illustrated by a sim])le example. Suppose a principal 
is interested in investigating the effect of after-school and Saturday 
employment upon the work of students in the high school. Taking 
the elements given on page 5, scientific research b'egins by a careful 
statement of the problem. It acts on the principle that a problem 
carefully stated is more than half solved. General terms ■will not 
suffice. Care is taken to single out the item to be investigated and 
to state it clearly and concisely, excluding all irrelevant problems 
that maiy be interesting in tbemsolvcs but do not bear on tlie item to 
be investigated. We might state our problem ns “How does the 
out-of-schooI life of the student affect the school V This'is altogether 
too genertal to be useful as a topic of investigation. It miglit include 
condition of the home, attendance at dances, movies, church, etc., 
well as employment. The words “ affect thfi school ” might 
include attendance, school activities, school spirit, as well us scholas- 
tic standing; iC might also include the effect upon the teacher and 
other \[tudents. A much better statement would be “What is tlm* 
effect upon the st^iolastic finding of the students of after-school and 
Saturday employment?'’ This is much more specific and omits many 
irrelevant things. Possibly a still b^ter statement would be “ How 
does the scholastic standing of students who spend no time in,pmi^ 
ployment after school and on Saturdays compare with that of 
students who spend varying amounts of time in such employment?” 
Here the causal relationship is entirely omitted, and the question 
' Correspondiogly restricted. Another source* of error would be elimi* 
naled if the term “ employment ” were clearly defined. Does it mean 
« for wages only or should work at home where no wages are given be 
included? 
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Next, great care is taken in thd assembly of data. Whatever data 
are taken, whetlier objective or subjective, they are subjected to 
rigorous critici.''ni and una/^^is in order to <li.scovor whether they are 
accurate, whether they are the •best obtainable, and whether they 
are relevant to the •problem nmler investigation. Kesearch of thil 
kifTd involves first-hand, i1i<|Uiry. actual contact with facts. Very 
definite methods have been forniulateS for determining the accuracy 
and validity of data. 

In the problem stated it is by no means ea.sy to secure reliable 
data. 'J'lie rejtort.s of teachers regartrmg out-of-school employment 
are very unreliable. Statements of students from memory of time 
spent are also unreliable. Probably the best method is to select a 
given week or* month or a jx’riod during which a scholastic mark 
is given and have each student report each da^or week the exact 
amount 'of time hff has spent in em[»loyhu-nt.^rhis is difficult to 
secure and even then i.s inaccurate unless checked up by refei'ence to 
employers and parents tinder wbom the work lias been done. Again, 
it is not always ca.'V to seetire reliable .'^ebolastic marks lor'the period 
under (^nsideration. These should be taken from the official records 
of the schools and not from the teacher's inomory of the.se records. 

After the data are a.s.'iemblod, they are analyzed with extreme 
care in order to find their bearing upon the problem. All irrelevant 
material is rejected, no matter bow interesting it may be. Other 
factors that might inlluence the scholastic .standing must also re- 
ceive attention. A student may be employed in an occupation that 
permits time ft>r study, us night clerk in a hotel: sickness or worry 
or social dissipation might afTect the school work of a student not 
employed; the natural ability of each student must be taken 'into 
consideration — that is, if t];^ effect of out-of-scliool employment on 
marks is to be investigated. Again, it will not bo sufficient to group 
together all who are eiap loycd and compare them with the group 
not employed. Theiimployed group must lie analyzed into those 
employed for varions amounts of time, for it may be found that a 
certain amount of employment has a good effect, while n larger 
amount has a bad effect upon school marks. Caro must also be exer- 
cised that a time of year be taken for the study that is free from 
undue disturbance due to holidays, final examinations, or the like. 

After this careful analysis wmes the formation of an hypothesis 
or tentative Fhnclusion. This involves freeing the mind from prej- 
udice, so. that, uninfluenced by tradition or [personal bias, the tenta- 
tive conclusion may bo the result of the data obtained. No precon- 
ceived ideas or prejudices arc allowed to have any inffiiencc. ITie 
habit of suspending judgment until all the evidence ds in must be 
forme<l. Jumping Sit condllisions from inadequate grounds is not 
Iterated. • ' 
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The teacher may believe that students .should *rive tlieir entire' 
time to school work ami believe that out-of-school employment is 
* harmful. On this account he may unconsciously put more weight 
upon certain data that tend to prove this opinion and less iiiwn 
those opposed to it. S<*ientific research never starts out to -prove any- 
thing; it may start out to see whether a certain hypothesis is true or 
not, but its obje<’t is not to prove it true or untrue; it is merely to find 
vrhat is true. 

m 

The hypotho.sis I’csidtin^ from the study desrril>ed should usually 
be stated thus: ‘‘The relationship hrtw«‘en the scholastic standing' 

an<l after-school employment of the students in hiirh 

school, investiprated in’tlio month of 19*2 , is ns follows:” 

(Here the definite facts are pdven in detail.) “This seems to indi- 
cate that in thi.s srhobl out-of-school employment for hours a 

week ha.s a stimulating effect upon the scholastic standing of the 
students.” Even here the tentative conclusion .stated is questionable; 

merely because the prroup of students who ^verc employed 

hours had better marks than those who were not emjdoyed and than 
those who were employed otlier lenprfhs of time wotild not prove 
a causal relationship. It might happen that they were superior in 
natife equipment; or the sanie force, pd?«ibly ambitjon, that led them 
to seek employment would also cause them to secure better schola.«tic 
marks. Such an investigation should attempt to eliminate all of these 
possible variahle.s. This may he done by giving initial tests that 
will show the relative intelligence of the two groups, their scholastic 
standing wlien the experiment begun, ami, if possible, any diirorenees 
» in ambition that exist. 

Nor is the re.search worker content \^ith the mere statement of the 
4®ntative conclusion. ■\Vherever po.ssiblo, he attempts to find whether 
his hypothesis i.s cori’cct by the proces.sof validation, of trj'ing it out 
in as many situations as possible to see whether it works. It should 
be followed up with other groups of .students in other years, in a 
variety of schools and with a variety of methods. Even then a true 
scientist usually con.sidoi's the conclusion as tentative, as merely a 
working hypotliesis that will be used until a better one can be foimd. 

This, then, is the essence of research. It is a method that takes 
nothing for granted, that subjects every fact, every step to careful 
8Ci‘utiny before its acceptance, and absolutely rejects any substitute 
for the best fact, the best data obtainable. It keeps an open mind; 
it is free from prejudice; it cultivates the habit of suspended judg- 
ment, and accepts any conclusion merely as tentative, valid only so 
long as it bears the test of trial. , 
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4. Pure research and practicaV^ rtfa^arc^.— Charters * has called 
attention to a very important difference between the steps necessary 
for a pure re>earch worker and those required of what he designates 
as tl»c ‘‘practical *’ research worker. It will be helpful to state these 
differences brielly. 

The pure research woi-kcr may select his problem from any field 
without regard to the jmssible usefulness of it« solution or to the 
practical l)caring of the problem itself. After selecting the problem 
his sole concern is its sohition by scientific methods. He is in no way 
concerned with it.-s practical application. His motto is “truth for 
truth:s .sake,’’ 

Tlic j)ractical research worker is profoundly concerned Avith the 
sf lection of the problem itself. He first look.s over his establish- 
ment (his school or class) and finds .some weakness or inadequacy, 
something that he wishes to improve. From this he .selects some 
asj)ect as a problem for research. Having selected it he uses the 
same methods for its .‘loliition as tho.se employed by the pure research 
worker. 

'\^^lile the pure research worker stoj)s with (he solution, the ])rac- 
tical research worker is not contented Avith this as a final stopT 
‘‘Pure” research Avorkers fi*e(piently seek to apply their “pui’e’* 
results to very mi.xed [U'actical situations, Avith dire re.snlts to the 
unwary. Having .started with the purpose of imjuoving his school, 
he must, after he has arrived at a possible solution, actually install 
it in the school and see how it works. This Avill often call for modi* 
fications due to conditions of the school plant, lack of money, or 
peculiarities of personnel. Educational philo.-^ophy to the pure 
research worker is incidental. To the practical re.search man it is 
all e.ssential, far more imj^rtant than research method ; for the set- 
ting of the problem, the formulation of the hypothesis, the interpre- 
tation of results, and the application of' these results to the school 
situation inA'olve expediency and depend upon philosophy. (This ia 
in reality merely a part of step 5 — verification, see page .5 involved 
in the solution and not a separate step.) In other words, the prac- • 
tical research worker in arriving at a sohition must take continually 
into consideration the practical situation in the place where the im- 
proA'cment is to be made. The final .step that must be taken by this » 
tyi>e of research Avorker is that of maintaining the improvement so 
that it will become a permanent part of the .system. It is very iin- 
IMuiant for principals and siii>erintendents to keep these distinctions 
continually in mind. The object of their research should always 

•Clwrteri, AV. At.: Pmre rrtrtirvk ond pnrPtcdl research of B4, Boowph, 

12:95-101, Sept. 1625). .. 
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improvement of procedure^ and they must recognize tliat they aie 
primarily responsible for seeing that such improvemeut is actually 
made. f 

, Strictly speaking, the last step stated by Charters is not a step in 
research as research, but it is an important duty and fiinctioii of the 
practical research v'orker in the field of education. By this it is not 
meant that the research worker, if he is it teacher, has the entire 
responsibility of seeing thiit the improvement is actually made; this 
must be done in cooperation with the principal and other teachers. 
It does emphasize the fact that one who has worked out the solution 
is usually in the best position to see that the solution is actually incor- 
porated into the .structure and organization of the school. 

Education provides ample opportunity for both types of research, 
the pure and the applied. Tliere are so many weak places and inade- 
quacies in all schools that it would seem the part of w isdom for the 
principal and teaclier to stress the practical side of research, leaving 
the field of pure research, perhaps, to those who are spending their 
entire. time in advanced study. 

b. The need for reinrcstigatlon of research problems. —One. of tlie 
greatest Aeeds in educational research to-day i.s for reinvestigalion 
(rf some problems that have already been investigated by some 
research worker. Education is badly in need of verification of con- 
elusions formed on the basis of single studies. There are so many 
possibilities of error in securing data, the conditions arc often so 
complex, the data themselves so imperfect, that conclu.sions can not 
be considered in any way as final. 

Probably one of the greatest services that a high-school principal 
or teacher can render is to take some .study already made and 
carefully duplicate it in purpose and method under conditions 
, somewhat different from those of the orimnal .study. This will be 
the best method of getting intimately acqnamted with real methofls 
'of research and at the same time of performing a very real pervico 
• to educatibn. 

III. THE QUAUFICATIONStPOR THE RESEARCH 

WORKER 

From the foregoing discussion it must be apparent that all teachers 
are not. fitted to do research work. Fitness for such work is partly 
a matter of natjve endowment and partly a matter of training. 
Those who do not have the natural endowment or the training should 
not attempt ifT 

^7ln oar eatluisiafim over the possibilities of research la education we have 
I ‘ perhaps attempted to make sclentiflc workers of too many people who are 
uufltted by nature, temperament, nnd general olucatlon.' 

— f 

'Brina, T. H. i'Probtm* (s tecondary edscaNos that seed lotuthn (Bchtol lAft, 

:.v Feb., 19M). 
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'Courtis* * has summed up the qualifications of a research workcP^ 
as follows: 

1. Emotionni factors — Drive. 

One can not successful resoarrii work unless (a) lie has tlie iirpe that 
comes from curiosity. (6) he takes ploasure in self-expression, In creation, 
(c) he feels that such work will be of real value either to himself or to 
others. 

2. Knoiricage — Effiricnry. 

No one Is ready to do effective rt^senreli until he Ims develoiH?d the 
following : 

(o) Ability to find quickly, to si leet, and In utilize the results of previous 

research. 

{b) Knowledge of and fucillty In ining ai>provod exi>eriinental procedures, 

induct. ve and dediadive proi-esses, logic and experiimuitation. 

(o) Skill in using appnwed edueatioiml measuring instruments. 

(d) Skill in uualytUnl methods, statistical and graphic. 

(r) Ability to generalizer to know when and how' to make safe generalizntfona, 

if) Skill in verification involving criticism and prediction. 

ig) Ability to selecd and organize the materials use<l in tlie investigation and 

to report the methods and results. , 

3. Voiiiion^Controi. , * 

The volitional factors neces.’^ary may |>e outlintHl a.s follmv^- 

(а) Visible evidence. 

(1) Coinage. 

(2) rerslstenee. 

(3) Open-mindedness. 

' (4) Hum llty. 

(5) Faith. 

(б) General piuvers.* 

(1) 8elf-dlroctlon — Independent In tlmught. 

(2) Helf-appraisal — Powtr to know one's strength and llDiltationd^ 

(3) Self-i*ontrol — Bower of self-control. 

(r) Convlctlon.M. 

(1) About nature— lenity of law. evolution, enuso ami effect. 

(2) Ab<»ut self — Potentialities, social consciousness, control of self, 

(3) Abmit opportunity — lieallty and poss blllty of discovery of truth, 

possibilities of growth in self and progress of soclety^^^^^' 

It will be helpful for each one who desires to begin research to 
examine this suggestive outline and make some attempt at self- 
appraisal in order to find whether he has the necessary personal 
equipment to instire success in his undertaking. An interesting out- 
line for such'self-appraisil is given by Carl E. Seashore in an open 
letter to seniors, published by the. National Research Council.” 

« CourXit, 8. A, : The lierelcpmeni of abUiig la rftfamoA (Studlei Ip Education, Yaan» 
book No. XV, tbo Nat 8oc. of College Teachers of Ed, SO pp^ 1920).* Adapted. 

*To tpls list of powers given by Courtis we might well add ** common sense.** 

•Tbit may be obtaine#by coffimnnlcatlng with the National Research CouneU. Waall* 
Ington, D. C. Anotlier helpful Itpt has beep compiled by Milton FalrehUd from replko 
received from ** sclenUits atudylng inanimate nature.*' TbU may be obtained by wrlttuf 
Milton Fairchild, The ChAmeter Bdueailon InfUtutloo, U. S. A., 8770 McKinley SCrnt 
(Chevy Chase), Washington, D. C, 

28018*— 2T 8 
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IV. TYPES OF RESEARCH PROBLEMS 

Theie nro ninny kind? of research problems that present themselves 
to the teacher ami Ihe administrator tliat are well worth investi- 
gating. These vary somcwlint in their method of attack and their 
tecluiique. While there is often no' clear and sharp line of demarka- 
tion between them, four types of problems may, for our present 
purpose, be recognized: (1) The historical. (2)' the experimental, 
(3) the philosophical, and (4) the survey. Each of these will be 
briefly discus.sed, and the procedures and technique peculiar to each 
will be outlined. 

1. 1 he Imtoricnl type. — This type of research problem deals, as its 
name indicates, with historical material. It may seek to discover 
some hi.storical fads or to ])resent in a coniiectcd way the develop- 
ment of a certain type of school, for example, “ Quaker education in 
the Colony and Stale of New .Jersey," by Thomas Woody.- In this 
the author seeks to discover the .schools est.-ihlished hy the Quakers in 
New Jersey (hiring a certain period, to find wliat their purpose was, 
and to presenbthe develojmient in a connected manner. No attempt 
is ninde to show their influence uimn the establisluiieri^hF^develop- 
ment of public schools. He does show, however, the influences and 
the beliefs that brought about the establislunent of tlic Quaker 
schools. Marcus L. Jernegan, in his “Heginnings of public oiluoa- 
tion in New England,’’ « has practically the .same problem. He 
brings to light the Aurious cnu.ses that influenced the cstablishniont 
of the early colonial- schools in New England, di.scovcra and assem- 
bles certain facts regarding (heir cstablislimcnt, and sliows, among 
other things, the entire lack of positive evidence that the Bo.ston 
Latin School was really opened in lG3a. 

In this type of problem there arc certain crucial point.s of method 
that are of siiecial importance. The first has to do with the re- 
liability of the source. Anyone who wishes to undertake an his- 
torical problem will do well to study carefully the material found 
in the references under “Historical research,” on page 29 . By no 
means all statements that are found iir. print' or 'In manuscript arc 
reliable. Just because a statement is recorded in the minutes of a 
school committee or printed in a suporinteiulent's report, it should 
not be taken as a fad unless it meets the tests laid down. It 
be a^ertained, in the first place, whether the document itself is 
genuine; whether it was written at the time when it is supposed to 
have been written. If found to be genuine, are the statements of fact 
records of happening or ,of opinions of the writer regarding what 
happened f This opinion or observation may be valuable, and often 

^ Poblitbed by tbe author. Pbitadctphln. 1923.. 

.■School BoTlew, 23:819-830, SOl-dSO. May and Jun«, 1015 , 
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is, ns corroborative evidence, but it is by no means as valuable as a 
statement of a fact. The opinion of an eve^yitnoss or contem- 
porary, especially if ho is a trained observer, is much more valuable 
than that of a person who was not an eyewilness and untrained. 
After all data are in and <'hecked, there is still the problem of 
proper and legitimate intei pretation ami inference. Great care must 
he taken in treating facts ns facts and not reailing into them other 
things that, in I lie light of recent developments, might he expected 
to have been in the original statements, (ireat care and rigid in- 
tegrity should be e.vercised in dealing with all facts and all inf^- 
ences. It is not wise to undertake this type of research unless one 
has been thoroughly trained in its technicpie or has the advantage 
of the guidance of expert adviiv. 

Many o))portunities will Ik* found for investigations of an his- 
torical nature; original material will often be. brought to light in 
cloaniug out <»ld closets, basements, and attics. Principals .should 
never allow old reports and records to be destroyed until they have 
been very carefully looked over to see whether they contain material 
that may prove of value. 

2. The experimeufal type . — The experimental problem involves 
the discovery of the effe<!t of a given 'elemenjt. Its melhod i.s direct 
manipulation, working with the given element, and observation. It 
is not historical, because it deals with a^present situation; it actually 
introduces exj>erimental elemcnt.s or singles them out, and observes - 
and evaluates outcomes. It is possibly the most difficult form of 
research to undertake outside of a laboratory, but one that promises 
the best ultimate returns for -the school in the improvement of 
practice. Its difficulty lies in the problem of isolatioi\ of elements, 
of control of conditions, and of actually determining whether the 
observed result is or is not the result of the element introduced. 

The success of the experiment depends upon the following con- 
ditions: 

1. Selection of a workable problem. 

2. The ability of the experimenter to control conditions so as to 
keep all factors and elements the same throughout the experiment 
except the element or elements whose effect is to be studied:* 

3. Selection and introduction of elements that are not cbtnplex 
but comparatively simple. 

4. The ability to measure ^he changes OT^results obtained. 

Unless these conditions can be reasonably well assured, the time 

and energy spent on experimentation must largely be fniilless. i 

These condition may be illustrated by comparing an oxperimeift 
in science with antoperiment in education. The physicist and’ the 
chemist can more easily fulfill these conditions than can the tidier, 
because of the nature of the forces and elements involved. Suppose 
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■ the investigator wishes to test the effect of different amounts of an 
acid on a given organism. He provides for uniform conditions by 
selecting individuals of the given organism that are alike; he keeps 
the temperature uniform; he prepares tlie add so that it sluiU be of 
a given purity. He then prepares his different acid strengths and 
mokes repeated tests pn the organisms and observes the reiiiilts. He 
has largely controlled tlkf conditions." 

It is much more difficult in the t*ducational experiment. Suppose 
it is desired to test the relative effect on English vocabulary of the 
metliotl of definitely teaching derivatives in Imtiii as compared with 
the ordinary method of ti-anslation of Latin .sentences with no teach- 
ing of tlerivati ves. At once the difficulty of .HH.‘uring uniform in- 
dividuals (»r equivalent grouj)s upon which to try the ex]>eriment 
arises. 

The same group obviously can not be used for the two pnrts of the 
cxfierinient. for wliicjievcr inHlual is first used will pro<luce some 
results, and so the group will m»t be the same at Ua* beginnirrg of each 
trial. "When the attempt is made to .secure two groups that are 
cq\iivalent, difference^: in mental ability, in English ability, in rate of 
learning, in outside inffuences, etc., appear, 

Even aipj)osing that all these can be eliminated, tliere are still 
diffei-enc* in mdside influences home and street, that n)ay cause the 
jpven results, rather than the niethod used in the ebussroom. There 
are also differences due to different teacIVei's; or if the .s;uue teacher 
teache.s e.ieh section, she may not be equally well Jidupted tv) the two 
different methwls. Hence the difficulty of securing satisfactory 
conditions is ver>' great. In .such an e.vpcrimW probably the Ijest 
method that can be emplowd is as follows : * 

1. Select t^vo groups of .students that are a.s nearly alikca.s possible 

in year in school, in previous preparation, in mental ability, in 
• comp^ative nujnber of boys and girls, in siiic of groups, .social back- 
gijynd, etc. . * 

2. Give each an initial vocabulary te.st and an intelligence test. 

3. Teach the two groups in exactly tlw sanw way except that in one 
group English words derived from I^tin are rtuphasizeil and in tHe 
other the .students are left to thera.selvcs to learn the derivatives from 
the translations and tlie grumnaatical work. 

4. A final vocabulary test i.s given to each- group. 

In both the initial and the final vocabulary test only the words 

derived from the Latin are considered. In com|mring the results of 
the initial and the fioal tests two methods are used.’ One of these 
compares the two groojw as wholes. The total vocabiriary gain made 

•A clear ond bolpfut gt*temcnt on fnctori tbat launt be tnken Into consideration in 
^ 0. OMitrol eipertment M giTen by Snhrie, Ambroeo t. ; TA« ftidacMro A^termfmidOM ef 

Ut umt i nn a t methoO, pp. Se-4a iWacwkH and. York, ISaS.) See aJao BlUiewuphy. ' 
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by the jorroup in which deriyatives are tanjrht is compared witl» that 
made by the other jrroup. The diffei'cnce between these, represents 
the advanta;;e of one over the other. If the total pain of the first 
proup is 75 words and of the second is 50 words, tlie superiorify of the 
first over the second is i!5 words. But when individual, scores are. 
compared, it i.s found that there is a tremendous Aariation in 
individuals, and conehisions based on pioup results are not entirely 
satisfactory. 

Hence unotli^r iiietho<l of comparison is used — that of pairing 
individuals havinp like clmraeteristic.s. In this meihod two individ- 
uals of relatively ciiuivaleiit mental ability and voeabulary are com- 
pared with one another and the relative pain of each 'is taken as an 
index of the .superiority of one method over the other. 'J’he final 
result i.s the averape or median of the pains and losso.s of the pairs 
compared. Even this i.s not entirely satisfactory, for there is no 
mea.surcmont of what (he group who pained in Enplish vocabulary 
lost in the aspects of th«* course in Eatin due lu the eoncentrution on 
.'•i>eeilic ieaniinp of derivatives as coinijared with what the other 
group did not lo.se. It might well l)e tliat such lo.ss would over- 
bahinee the things actually gained. Relative values inu.st always be 
taken into consideration in evaluating and puttinp into practice 
re.MiUs of inve.stipalions such as this one. Even thoupli it is so 
iiiisatisfactory, this illiistratiuu may serve to show' something of the 
diiKculties involved in this type of problem. 

McCall '® describes another method— that of rotation— that ran be 
u.sed to good advantage with two groui)s. In this type of research 
work the caution given on pages 12 and 13 should be cmphasizedi 
Select for the first e.xperiuient some extremely simple thing that haa 
*»hviou.‘\ results. After this has been mastered a more complex one 
may be attempted. An experiment that would be simple and helpful 
might be the determination of which, of two ditferent times for the 
a.s.><igning of a lesson was more effective, at the beginning of the neci- 
ttttion or at the end. First try assigning the next Ic.sson at the close 
oOlie recitation period, ^hen after continuing this for a certain 
length of time try assigning it at the beginning. Care should be 
taken tltRt the. assignments should all be of the same type. Each 
method should be continued long enough to show certain results — 
say for a mouth or longer. During the time careful notes should be 
taken of the difficulties involved in assigning the lesson at-tlie par- 
ticular time, of the effect upon the class in understanding the assign- 
ment, in remembering it, and in its usefulness as an aid to study, 

Tlie comparative achievement of the class dtuing and at the end ^ / 
each period of .time should be carefully noted. All these obseirva- ^ 

**McCall« WlUlam A.: JJon to experiment 1 h eiucatk)ii, Uacmlllua, 1023. * 
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tion^hould be reduced to writinpj and the final comparisons of the 
two niethods of assignment should be made from an entirely unpreju- 
diced point of view. 

McCall recognizes and describes thrc'e niethods of expeid'menta- 
tion: tl) The ono-groiip method: (2) the eipiivalent group inetiiod; 
and (o) the rotation method. Definite suggestions are given hv him 
for methods of control of coyditions and evaluation of results. 
Finally, he, states several experimental problems and gives sugges- 
tions for their analysi.s. The teacher who wishes to engage,- in this 
type of re.search should carefully study the siiggestions given by 
McCall before beginning the e.xperiinent. 

3. The philogopkical tifpe , — The philo.sophicnl type of research 
problem 'was much more conmmn scune years ago when the study of 
education or “ pedagogy ” 'was considered inerely a branch of phil- 
osophy. It still has a very legitimate ])lnce in educational research. 
It is this type of. research that Monroe has in mind when he .says: 




* j 

In niy JialKinent Uiere Is nraotit need for n type of crltlcnl study In the Held 
of Hwoiidary education wlileh l.s not ineluded In the popntar co'noept of,e<lnea- 
tloaal research, or at least its im-Inskm Is not explicit. The tyiH> of .studies 
whlcli I linve In ntlml are (leduction rather tlian tnductlon. For example, a 
great deal of so-<*nlle(l research has related to sui)orvised study, Imt a <T:tical 
examination of tlie pnldlsiicd refiorls reveals prnelleally nothing eoneendnK 
the actuai procedures that a tcnelior*.«hould employ In dinvtlnn learning out- 
Blde of the recitation period. These proeedures will not bo discovered directly 
by collecting and tabulating (iiiantitative data. Tliey must de<luced from 
tie laws of learning and the principles of teaching. ^It Is perhaps true that as 
yet our formulations of the.se laws and principles arc not sufficiently complete, 
so that the <Iediictlona will have a high degree of depeiidahlllty, but tentative 
deductions are at least possltde. After ibe pmeedures wldch a tonclier should 
employ have bi'en deduced there will, of course, l>e need for verification, wliich 
in some ca.ses should be experimental. 


This type of resen rch is probably .seen in its j)ure.st form in mnthc- 
maticnl re.soarch, where £bc investigator sets up a .series of postulates 
' and jtroceeds to analyze these postulates and’to develop theorems jor 
systems or draw conclusions. Often no objective data whatever are 
used, and frequently no practical application of the conclusion is 
attempted. The accuracy of the research dcjiiends upon the validity 
of the postulates, the accurac}' of the analysis, and the particulaT 
element^aken upon which the conclusions are bn.sed. 

This ty^ of research might be *ised in education for the solution 
•of the problem of the place and function of interest in teaching. 
This problem might be attacked from thfi. historical point of view 
alone. If this were don6, the problem would be to secure reliable 
sources of educational practices in the past and the theories of edu- 

I catoi# indifferent stages of the history of education. Or it might 

i ■ ■ ■ ■ 

U llonro«, W. 8. : Quot^ by Brlgg* In Behool lAfe, 11 : p. 118, 1026. 
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be attacked from the experimental point of view and an effort made 
to determine by actual experiment what are the results of the use 
of interest in if»adiin" as compared with results when interest is 
not used. 

However, if the problem wei-e investij!:ated by the philosophical 
method/* the steps would be — (1) A clear stutomenl of the concept 
of interest as applied to teaching; (*2) an analysis of the concept to 
determine the various elements involved; (3) the applicntion of each 
of these elements to the process of teaohinj; to show what elements 
are likely to be useful and what arc not, and to make clear the 
utility ami the liiiiitiitions of the concept as a whole and each element 
in p;U'tieiilar. 

The chief points of ilifficulty are in the analysis of the concept ard 
in the selection and !ippli<ntirm of the elements to the process of 
tpnehin}!. It s1k)uI(1 be said that, even thonjrh these diflicnltios ar« 
Mict‘e>s{iilly surmounted, the validity of the coneliisions depends en- 
tindy upon the }icnira<*v of the «)ri;»inal concept or postulate. If 
this is tlot'^’alid, then no ainmint of npnlysis or of reasoning will bring 
vali«l iv^ults. Aeconlingly. extreme care inn.st be taken in select- 
ing and validating the original postidate. In doing this all the 
met hods of historical research may he nsod or those employed in 
tlic survey type of problem may i>e utiliztsl to discover what the 
accepted concept or postulate may l)e. If this is not tione, the result 
wild be entirely useless. IIow(‘vcr, it must be remcml>ered that all 
postulates mul concepts aie mci*e hypotheses, valid only as they stand 
the test of actual practice. On this account it is sometimes entirely 
justifiable to ncco])t as a b.asis for analysis some concej)t that is’ not 
generally accepted. If wc (o<»k us our basis only such theories or 
postiilnt^ ns are gcncimlly ncc\;ptcd, no progiT.sK would be possible. 
Progress comes from n<‘w ideas, new concepts, new po.stniatos. 

.\nothcr |mint. should always be keid iu mind ; Any philosophical 
rcseaich in wlucation .should b<‘ folioAved by experimentation to de^ 
Icmiiue the validity of the eonclu.'^ion and to make clear its applica- 
tion to edjncalional practice. 

Another slightly difierent phase of the phiIoso]>hical tvpe of re- 
search problem is found in tlio examination of current beliefs to- 
determine wliethcr such beliefs are xyarranted in the light of facta 
and principles that have already been aoceptetl as valid or to deter- 
mino what modifications must be made in such belie:fe in order to 
make them harmonize with facta and principles^ We might taka 
for such a problem the cunent belief that the jiuiior high school ii 
the school for the adolescent The first step would be to examine 
the writmgs of men wTio arc co nsidered authorities on the junior 

Se« liSaplefl, Douglas: An approach io the epfitheHo itudt^ of (niertet 4it stfscafliNli 
Warwick A York, 1021^ where a tiiallar method it asetL 
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to 

hipli school to see jjjst what their belief is. Havin<r estiibli«hed this 
and formuj 4 ite<f the belief, the next step is to determine by examina- 
tion of authorities what is meanly “adolescent.” Then would come 
the investigation of fa<-ts alred^ known rejrarding the varyin;; n^ies 
when adolescence be^in.^; the distribution of students in various 
stapes of physiolopical maturity within the, various grades of school 
as they now are; the assembly of facts regnrdinp intelligence levels 
of .students to determine whetlier all boy.s and girls ojin profit by tho- 
Tvork of the junior high schtml as now constituted; the examination 
of the facts regarding the various achievements of pupils of the 
same age and stage of physiological maturity; the analysis (jf facts 
and opinions regarding what actual differences there jjrc in attitudes 
and interests between immature and maturing .students. ’After these 
facts ami i)rinciples were assembled and analyzed we would l>e in a 
position to determine whether this belief that the junior high school 
is the .school of the adolescent is valid. Taking into ctmsideration 
the variations in tlie ages of beginning adolescen W. tlm /widi> range 
in intollige^nce levels and achievement in school subjects, we would 
be in a position t(» describe modifications in the present elementau v 
and junior high .schools, if this belief were really to be a#Pepted. > \ 

In this study there have been no new' facts brought to light, no new 
materials presented, but real research has been accomplished in as- 
sembling and analyzing facts and materials in the light of a certain 
belief taken as a basis. 

While this method is not often used exclusivity in educational re- 
search, it occupies an important place in many investigations. In- 
deed, it might be said that one of the greatest peeds of education 
to-day is this type of research, in order that there may be devolojwd 
a real philoA»phy of education that takes into account the most up- 
to-date contributions, of modern science. * 

It also has an important place in the evaluation of certain methods 
and procedures in the classroom. A good example of this is found 
in the evaluation of the Dalton and Winnetka plans, by W. H. 
Kilpatrick.** This type of research problem possesses less value and 
has more danger for the ordinary research student than any other 
tyi>e of problem described. It should seldom be undertaken by the 
high-school principal or teacher. f 

4. TAe survey The purpose of the survey type of investiga- 

tion is to describe as accurately, objectively, and quantitatively as 
possible a doss, a school, or a'sdiool system — city, State, or National. 

It usually traces relationships, indicates causes^ and suggests im- 
provements.' It often empl($y^ the historical method in determining 


>*l>rent/ a>urU> Yearbook of the Nnt Socle!/ for tbe Stud/ of Education. Part II. pp. 
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4 

the validity of data and the- philosopliieal method ^ analyzing ob- 
jectives and outfonies. By its very nature it makes more frequent 
use of statiKtical methods than any other type. 

Examples of tliis tyjje are found in the various school surveys: In 
Colvin and McPhail : “ Intelligence of seniors in the high schools of 
Massachusetts J. H. Kelley’s “Teacheys’ marks, tli^r variability 
and standardization O’Brien’s “A study of the school records of 
pupils failing in academic or commercial high-school subjects.”** 
fThis inchulys the two tyj)cs described 'by McCall as “descriptive in- 
vestigations ’’ ami “causal investigation.s.” It may readily be seen 
that it is iinpossibre in practice to sepan^te the two. 

The chief dilliculties in this type arc: . 

1. 8ecuring4cliable data, discriminating between opinion and fact. 

2. Selecting relevant material, and distinguisliing between useless 
and unnecessary details and facts and factors that are really im-t 
portant, 

3. llelnting facts observed and results measured to peculiar condi- 
tions, in the school or locality; i. e., interpreting conditions and re- 
sults with reference to local needs and condi^ns. 

4. Selecting standards of comparison%hat are valid for the partic- 
ular school. ^ 

5. Distinguishing between facts or conditions closely related in 
time and place and caiLsal relationship. 

C. Describing accurately and adecpiately the facts and condition's 
investigated. * 

In this type of investigation very great care must be taken at all 
stages. Many otherwise admirable sthdics have l)oen made valueless 
by lack of care in securing reliable data. Facts mu.st be obtained; 
mere opinions alone w’ill not suffice, and such opinions as are con- 
sidered must bo evaluated with careful discrimination. It often 
takes much time and persistence .to get at the real facts, luit unloss’this 
can be done the investigation is worthless. Groaf care must also be 
taken in interpreting facts and conditions and especially in forming 
conclusions about the cause of a certain effect. The best scientists 
arc often led astray in this particular. « 

This is illustrated by the commonly accepted .statement by clas- 
sicists that Latin provides mental training superior to that of an)| 
other subject. Tliey base their conclusion upon this unquestioned 
fact. College students who have taken two or more years of Latin in 
the secondary school attain, on the whole, higher scholastic^ standing 
than those who did not take Latin in the secondary school. There, is 

i I—. ^ i > 1 

8. B«». of BMue. Bnl. 1924, No. 0. , - - : 

^ Columbia Ualverolty Teacberu Cblloao Coatr. to ^oc-o No. Ckl, 19i4. 

**0’Brlen^ VYandi R: The hlot-BChool faUureB (Columbia TJolfersltjr Teacb«ro Colley# 
Coatr. to#Kdoc., No. 102« 1919)« 
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no dispute about the fact as stated. The difficulty is regarding the 
validity of the conclusion. The question is this, Was the cause of 
thf, superior scholastic standing of the Latin students due to the 
I.atin they studied? Are tlft*re no other factors that may have caused 
this? On investigation it is found that as a group the Latin students 
in our secondary schools are of a higher intellectual type than the 
non -Latin students. This fallacy of selection tends entirely to vitiate 
the conclusion. It does not prove tj^at Latin was not a cause, nor 
doe.s it prove that it was the cause. 

Constant care must be exercised by everyone to avoi<l this kind of 
mistake. In this type, as in every other involving the u.se of statis- 
tics, tlie investigator should thoroughly familiarize himself with the 
CViiig-oved statif^al method. It should also be said that the g.xCrcise 
'of plain common- ^nse will often enable one lost in the maze of 
stati.stics to find his way oiit and to avoid absiird statements. Not 
long a^o it was' rej^^rted that two-thirds of all the gra<hiates of X 
high school had failed in a certliin college; this was compared with 
the record of Y high school, whe^g only onc-^third had failed in the 
I same inkltution. On investigatiqia it was found that only 3 grad- 
. nates of K high school hpd' attended the college arid 2 of them had 
failed, I^hUp- in the en.se ot;th| V blgh school. C>0 had entered and 
2Q had failed'.^ Query : Whi(*l\ thf, better high school? Can we 
teil from the data presented ?, * 

Another (ganger, all too apj>a^t ii| mrtny statistical s'tudic.s, is 
thdi of faWing the average, mesjian^‘;<)r mode an adequate desbrip- 
tioi^ of the achievfgient of a grdnj) "of stiident^ Suppose two classes 
in ahaoeW;«are being compared, and tf^ are used to measute the 


achievement of the two groups 
groups .Were as folldtysi 
X • , ciImi 

c '1 
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Tlrir. _> 6 


Class 1 Clasa 2 

6 ^ 70 - 1 4 0 

4 »4 

5^^) 2 8 

Rl-55 2 2 

^ 50 _ 1 

36-40 1 

A* . 

It will be'seen diat tile. averajjHachievement is the same for the 
two cla.sses, hut ii^s^ite.of thisij^e two classes are essentially dif- 
ferent! Class 1 is very irregular, having some who have high achieve- 
ment and others who are very low. Class ^ is much more regular. 
The irregularitie.s of class 1 are very signij^cajit) ttnd the cause should 
bft carefully investigated. In both cases the entire distribution should 
alwa^i^ be shown. If the attempt is made to jud^ the efficiency of the 
teaqh|^s/it might be found that the methods employed by the teacher 
of class 1 were more effective .in stimulating the comparatively few 
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who were very bright and not so eflScient for the other students. The 
teacher of class 2 n^jght be holding back the bright ones and spend- 
ing most of (he time on tl<e dull ones. 'Whatever the causes may be, 
the only safe procedme is to take the entire distribution of the 
class into consideration. Taking the average serves only to obscure 
the significant things. 

Possib'K the mo.st .difficult phase of a survey investigation is ob- 
taining data covering a serios of years. It can not be too strongly 
urged that records Ijc careftiUy kept on all |)hii5^s of tlie work of 
the .school and as carefully preserved. For example, we should like 
very much to knoV.whnt ett'ect the junior high sdiool has had upon 
school enrollineht, elnhgmtipn, and ovoraganoss in each grade. It is 
practically iiupos.‘^ible to secure- any reliable data on these points 
because of the lack of definite records before the i^tivciuction of 
the junior high school and after. Prindpals ,ancl suj^rintendehts 
should always be careful to make a<lequato record.s and preserve them. 

I'lie cc^e method of iiu'catt^ation . — One of the inetlioils of investi- 
gation that has come into general use wit|iin the past few years is 
the case method. This method 1ms been developed nio.«tly in certain 
phases of social work and has arisen because of the difficulty of secuy 
ing reliable data regarding individuals and bec*ause of the complaKity 
of the problem of diagnosis. It has come to occupy a very important 
place in education because every educational problem is a social prob- 
lem and sooner or later must deal with individuals. At present 
is used' mo.st frc<|uently in so-called problem cases; that is, in the 
study of students who for various reasons are not properly adjusted 
and in conse(pienro cause trouble or are likely tp drop o\it of school. 
^^^^ilc tlie ‘^0 proWeiu cases come up first for consideration, there is 
every rea.son to believe that the same method.s may Im used in study- 
ing other childien and in diagnosing their problems. 

The following outline of the chse method is adapted from the dis- ^ 
cusslon by Morrison : ” 

I. Svmpioitut . — ^The first step Is always to pet at the facts that indicate tlmt- 
hc is apy>l*lcm case; not his history but the symptotna that have been noted. 
This Involves finding bis chronological age, thp marks received In varl(m.s sub- 
jects, Instances of misconduct, latenesses and absences from school, etc. . ^ 

All statements mast be actnolly verified. They most be taken from .school 
records when possible and only first-hand iDformatiou accepted. The informa- 
Uou tbuB obtained will often be anfilcleut to abow (bat the caaae is not a problem 
one at all. Care should be taken here to exclude all that does not have to deal 
with present symptoms History la valuable only as It throws light upon tho 
causes of gymptoma, but when gathering data onHymptnata history rtiould lie 
excluded. When the data are all in they shonld be written op carefully and 
summarlced. 

re — ? 

•» AlorrtaoB, Henry C. : The pnetiee ef teaehdnp <s the eeeonietw aAeel, pp. OlS-dSO 
(UnlTcnily of Cblcta6 Preoo, 1026.) Be* also Beavia W. C. : Pi« mtlfnitmemt M ‘ 
fm*er eed eenter Mph eeheeU. (Benth. 1036.) ^ ‘ 
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II. Examination. — With fhe syniptom.s noted, more precise Information 
regarding the case Is ubtnined by various tests and examiuatioii.s, These are, 
of course, selected witlf reference to the needs of the piirtloiilar casse. Some 
of these are here given : 

A. Psychotphysh-al. 

1. Vision — normal. 

2. Ilciirlng— iioniml. 

3. Coonliimtitai ( iifiironniscnlnr)— no good lest.s are avnlluble but 

careful oliscrvation will give helpful data. 

4. Speech — iiorunil. 

B. Health. 

1. Vital lmh*x (lielglit-woight rati'*). 

2. Nut l it Ion. 

3. Teeth. 

4. Genornl physical eomlitioii. 

C. Kdiieationnl. 9 

Standard te.sts' of various kinds suitable to the grade of the pupil. 
The.se arc to 1 h> u.sihI to discover any ruiidiinuoital wen kne.s.se.s in hia 
pievlous tiniulng ami nls<i to check up on the marks he has received, 

D. Mentality. 

General intelligence test. 

It Is l)cst to give .several types In order to avoid aecldental results. 

III. Health and plij/KU'ol hintoru.—\ery careful and exact infornmiion should 
bo obtniiicf'. not only of scriims illues.si^s, .sciirlct ^ecer, nieask*s, ete., hut of 
other illnesses and operations for adenoids, tousil.s. nnd any accidents that may' 
have affected the health or rc'slstance. If possible. :i c<.nip!etc rc^.|•d of growth 
in height and weight and pltysiologieal maturity shouM be oldnlmd nnd care- 
fully recorded, 

IV. history, 

A. Promotions. 

B. Kind of work done. 

C. Chanf^ed locnilon — home and si hool. 

. D. Quality of schools jittended. 

E. Uelatloa with individual loadiorsf 

V. Family history, 

A. Ancestry, parents, brolbers and sisters, nntionalityt. mental and 

criminal history, etc. • 

B. Economic .stntus and lilstory. 

The previous and present flnimolal and economic situation of the 
family. 

C. Cultural resources of the home. 

Education and training of parents, bmiks, music, and cultural 
ntmwphere of flip home. 

D. Relation within the home— with parents and brothers and sisters. 

E. Attitude of parents toword soelpfy. 

F. Adjustment of parent.s to American stnndard.s. 

G. Control exercised by parents of children— * 

Kind and amount of control, ' 

VI. Sociai hhtont and rontartt.—Tlie pupils’ soHnl background outside the 

Bchool nnd Uio home. 

A. Chilrch and Hunday gchool, Boy Scouts, etc. 

B. Associates. 

C. Bummer camps. 

1>. Gang aitHiatidns. 

E. Abnormal sex history, 

P. Court record. 
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VII. Diagnosis . — This is tbe working bypothesis of the oaxxae or explanatloii 
of tbe symptoms or the probletti and results from a careful analysis of all the 
(lata obtained, it Is not necessarily delayed until all the evidence Is in, for 
guesses or lopotbeses are actually being made and leads followed up at many 
ittages, but the linal dfagnosis is not actually made until tbe evidence Is in. 
Possibly tbe better statement would be that every guess or lead is followed until 
the worker is reasonably sure from the evidence that It is correct. 

VIII, 7'rratnicnt . — Out of the 'diagnosis grows the defliiito systematic treat- 
ment. It oftem happens that the treatimmt shows that the diagnosis .was not 
correct. In tin case w’e must go back for further Investigation^ In one sense 

.the treatment may he considered ns a step in verifleation of the hyi>othe.sis ; in 
another it is Itself a guess or an liypothesi.s .set up as a possible remedy that 
itself needs verifleation by the flhal slop. 

V. THE QUESTIONNAIRE 

The questionnaire method lias been so *;enerally used and so often 
misused that ajieeial consideration will Iierc be given to it. 

In the first jilace let us remember that tlio questionnaire is often a 
• lar.y man‘s method of ‘lettin'? alloi'etl information that could be much 
better obtained in some other wav. It is easy to sit down in the quiet 
of one's study ami make out questions for some one else to answer. 
But sueli a method is very wasteful of the time and energy of the one 
to whom it is sent and is frequently wasteful of the time of the maker, 
for these questionnaires not infrequently find their way into the 
. waste-paper basket, and many of them should. One has no right to 
take the time of some one else in answering questions when he hinuself 
ran find the answer elsewhere. Nor, on the whole, can lie consistently 
a.sk some one to sjiend his valuable time in work that will not pre- 
sumably prove of value to him or his school. After he hns decided 
upon the data he wishes, he should search thronjrh all available mate- 
rial to {jo.e whether these data can not lx? obtained through printed 
reports. If they can and he does not have the reiiorls, he should 
send for them and get the data for himself. If the data given in the 
reports are not in the exact form in which he wishes them, he should 
change his own plan to tit the form used, where this is'jKissible. 

When he has exhausted all available material and feels that he 
mus^ resort to the questionnaire method, let him observe the follow- 
ing directions and suggestions : 

1. Make the questionnaire as brief and concise as jjossible. One* 
page questionnaires are much more frequently, answered than those 
of 2, 3, or 4 pages. 

2. Organise it so that it ckn be answeredJjy.ohecks or by the inser- 
tion of a minimum number of word»or"'fi^re8. 

3. Be careful of the ifiacing. Leave enough space for the answer. 

4. Ask only for the information actually intended for use. The 
greater part of many questionnaires is never used and serves merely 
to clutter op the s(udy. 
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0. Questionivai'res s^ouUi orcii/jWily ’Call ifor * facts, not opj(hions.^ 
Such^uestions are.niOro fheqy^itiy answ(*i-p(lj t»^ce less {\u\fJoi the' 
one ^vno fillA tlictii out, ‘ami. a|t'iii^oie reliable . ' m 
7. WliQ» juilfrnients or vpi^Jiui.s are asked, the questions should be 
frafned asto exdude'dogrniatic answer.s based on. enthusiasm and 
o^ini(\ns. and to assure ref[oclive thinlciiig. So fa/as possible objec- 
tive evidence for jiid^ments should be called for“,»Exainples of two 
* po.ssible methods are here, jriven in orij^^o uu/ile this <-lear. The 
general object i,s to find the opinion 'iii teatlieis on the following 
problem t ^‘Slio*fil<l 14-year-old piu^s of ^igh intelligence 1 h* ])ro- 
inotC<l into^k junior high jKdi«f)Ti-\ en though they may not have 
completyO work of the' «n.\tb grade? " 

47^^ — ‘'-ShoiihJ I4-yeai -ohI pupils of high intelligence he 
^l^vnccd into the jdrmr high school rejiardless of their mastery of 
^^Bjcct matter?” Such a cpiestion if suinnitted to a facultv would 
ordinarily "be anj>wered in the negative, because of the shock to 
s/diot)lmaster attitudes, and accordingly should be avoided. 

Si fOiul foi'i }); — ^‘Assuming that rea.sonable facility in reading ttie 
venth grade mathematics book.s, se\enth grade In.story lajoks, .sev- 
enth grade seience hooks is essential to success in the seventh grnile; 
and assuming that certain abilitie.s in computation, .spelling, |x?n- 
nnanship are essential to success in the seventh grade, the question is: 
Is anything else essential to success in the seventh grade? Name 
such knowledge and skills as are necessary toy^iicccss in the .seventh 
grade.” 


“Assuming reasonable facility in the above-mentioned knowl- 
edges and skills, the question is: Should pupils who ar4 14 years 
of age, of high intelligence, be promoted reganlles.s of whether .they 
have completed the work of the .‘•i.xth grade?”- With this wording 
of the question there could probably more reflective thinking as 
a basis for answering the question, and the conclusions would be, 
therefore, more valid'Than those based on the first form. 

8. llcfore semling out any questionnaiie it should go through the 
following stages: 

(a) Very careful furmiilution by the author and arrange- 
ment in the form to be u.sed. 


^ (6) Submission to some expert for ailviee and correction. 
(c) Try-out on teachers or others not primarily con- 
cerned — disinterested pereons. 

(rf) A try-out of the revised quest ionnaii’e on a group as 
nearly like the ones to whom it is to be sent aa> 
possible. These try-outs will often show the iii- 
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accuracies of statement, the equivocal questions, and 
otlior undesirable features that can be corrected be- 
fore the questionnaire is actually sent out for replies. 

0. Be sure that each copy is clear and readable. 

10. Always state clearly the purpose of the investi^ration. 

11. He sure that the *invc.‘--tipator's name,^^! addre.«s are clearly 
^iven on the quc.stionnaire. 

l‘J. Provide a jdace for the signature of the one who fills out the 
ijiiestionnaiiT, (ogetlier with his position and the date of filling it 
out. 

i:l. Provide an extra i'oj)y so that the principal fnniishing tho 
data may Iiave on file in liis oOiee a copy of the data collected. 

14. \ self-addressed envelope inolosed with the (juestionnaire will 
often bring good rcsidts. 

1. '), .'^end a copy the result of tlie investigation to each one who 
fills out tlic questionnaire. 

VI. REPORTING RESEARCH 

•\fter the investigation has been made comes the report or writing 
up the method and the re.sults. This is very important. Many 
invalutiblc rcseat'<'h studies make no eontribntion and do not affect 
educational practices either beoau.se they are never re])orted at all 
or bei-anse of faulty, inadequate description.s. Consequently, great 
care sliotdd be taken in reporting all etlncntionai^re.cenrch. 

In general, the report should be of .such a nature as to, give the 
reader a clear itlea of the problem, the ntetKods of prot^dure, the 
limitations, tho «lata n.sed. and the Conclusions. For convenience, 
tl*e following outline of .desirable procedure i.s given : 

{a) State clearly the purpose and limitation.^ of the inve.stigation. 
This con.stitiites not only it.s scope but also its roiitribiitutn in the 
field where there have been other reseaichcs. 

(ft) Des4*ribe the methods, sources used, and mechanics in the 
investigation. 

(c) In the body of the report include the discussion, tabulation, 
and graphic representation of the data of the research. 

(d) State the findings, conclusions, and recommendations ns far 
as the research warrahts. 

(c) Place in an appendix any material that is illustrative or 
explanatory and is not needed in the bocly of the report. 

.(/) 'Reports slioiild include a complete bibliography of all wurces 
used. This sliould include careful annotations indicating the nature 
of eacTt source. The items of the bibliography should be properly 
classified and systematically arranged. 
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{g) As a general rule, a report should have a table of contents, 
a separate list of tables, charts, and diagrams, and, when of con- 
siderable length, an index. 

VII. SUAIMARY OF SUGGESTIONS AND 
DIRECTIONS 

1. * h^xaniine your school adniiuistnition, curricuhiiu. methods, and 
personnel to find some outstanding dithciilt ies or inade<nincies that 
will serve as rcseiircl\ prol)lenis. 

2. Select a jiroblein that will make a diffc tenet* when it is solved, 
the solution of which will tend to improve practices in the school. 

!1. Investigate earefiilly to see what scientific research has already 
been done on (he particular problem which you have selected. It 
iiMiy have already been solved, hiif (*ve(i if it Ints. other similar 
studies might well be made to tesi the conclusions of the stud'»'s 
already made. If it has not het'U solved, such an investigation will 
often|give valnahlc suggestions regarding methods of prheedure. 

4. Before beginning research on any problem, think it thnaigh 
carefully, iletine it clearly, relate it to the larger problem of wliich 
it is a part, and formulate it detiniti'ly. subject, of course, to re- 
vision. 

5. After you have selected a prohleni that looks promising, obtain 
the criticism and advice of some expert in the Held with' which you 
are dealing before uetuully undertaking it. 

6. Many large prohlem.s- should be broken up into units, each 
unit covering a specific phase of the larger prohlem. In this way 
the problem i.s mii<le more speciric. and each unit is narrowed down 
to a .small enough Held so that it can be attacked directly. For your 
first .study .select us .sitnj)le a problem as you can find. 

7. Consider and evaluate all possible methods of attacking your 
problem before determining upon the procedure which you are to 
follow. One method of attack often brings quicker results; another, 
resiilts that are more accurate. For voiir particular pnrpo.se, which 
is the best method to follow i 

8. Define and state your technujue so clearly that it can not be 
misunderstood, and so that some ^ one el.^e could duplicate it and 
thoropglily check the re.sults by repealing your investigation in a 
different situation. 

ft. 'riie nudliod of procedure or attack should be carefully outlined. 
If .statistical calculation i.s involved, it should be according to ac- 
cepted mathematical procedure. 

10. In the minor i.ssuc.s that ari.se, do -not lose sight of the major 

problems. 7 

11. When making comparisons, be sure th^t the data used* are* 
comparable. 
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12. Differentiate clearly between what is fact and what is mere 
opinion.,. 

13. When opinions are given, they should be signed by the people 
wild contribute them. 

14. Exercise great care in the use of the quc.<l?ionnaire method; 
unless carefully safeguarded it will not secure results that are trust- 
worLliy. 

15. Avoid the error of drawing general conclusions froiii data that 

are inadequate. ' 

16. In many studies all the educational outcomes must be taken 
into consideration. It might not l>e sufficient to consider only one 
outcome in determining the effect of a particular nmthod of 
procedure. 

IT. If there are weakmvses in your method of attack, point them 
out; if you worked und«’ limitations, point these out; state what 
possible innccuraci(‘s there may be in your findings. Hone.si con- 
clu.<ions result only from honest consideration of all the facts and 
conditions. 

IS. Keinendicr that all .scientific conclusions are tentative; at be.st 
they arc hypotho.scs that will, it is true, furnish the basis for action, 
-but must be modified or rej(*cted upon evidence of their inadequacy. 

10. lie sure to test your tentative conclusions by priutical situa- 
tions and modif^hem in such a Avay ns to secure practical results. 

20. If in a pwition where this is possible, see tliat the solution is 
maile a permanent part of the work of the school so that the im- 
proved results Ifttty bo actually secured. 

21. In reporting your research consult the pamphlot.s li.sted in this 
bullefin and make sure that you use the forms listed ns most desir- 
able. Make u.se of graphic methods in your ])re.sentation when- 
ever thi.s will make the meaning more definite and clear. 

VIII. RESEARCH AGENCIES AVAILABLE FOR THE 
PRINCIPAL AND TEACHER 

1. National Committee on Research in Secondary Education. 
Chairman, J. B. Edmonson, University of Michigan; secretary, E. E. 

Wiiules, Bureau of Edugttion, Washington, D. C. 

* . * 

This cunimlttee is cuinposod uf reprusi^ntatives of the leading agencies 
in the country dealing with secondnry education. It works In cooperation 
with the United State.s Bureau of Education anti in always ready to assist 
, in pronioting^ueational researeli Ity miggestion and advice and by actual 
cooperation. 

2. National Education Association, Research Department^ John 

K. Norton, ‘ Director of Research, 1201 Sixteenth Street NW.| 
Washington, D. C. . 
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Thli depHrtment is constantly enfcaged in rew'arch in the entire field of 
education and stands ready to a.ssiHt research workers to the limit of its 
facilities. 

3.'Bureau.s of research in State depart meilts of education; 


Wherever a State depnrtnioiit of «:duoatl.)n lias estahlished burenus of 
re«‘arch, they can lie relleii ui*on for assistance. In many ca.ses wliere 
there Is no burenu of res«>nreli iniicli help can lie obtaiiu-d I,y «-nmiminl. 
eating with memlKTs of the .stuff who are siKs-ialists in tlie various fields. 

4. Bureaus of research in city school systems. 


Many cities have now establlslieil burenus or^epartinents of research 
In connection with tluir .scliool systcuns. Tlie dlreefors of the«< iiurenus 
aiWaiways ready to Kiv;e friendly advice and crltleism to research workers 
J/rvlt\es where no research facilities a<^ available. 

5. Colleges and universities. 


The prineirni and teacher can always rely npon professors of edin ation 
and dlrc-ctors of researrli in universities and eolleges to give needed iidvhe 
direction on voriims phases of resen rcjj^rolileins. ^ 
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.University of Illinois. Bulletin, No. 25, 1925. Price 50 events. 
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cducntional r^earcli. linuluable for the rt'S»*arch worker. 
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(1) Grlzzell. E. D. Origin and development of the lilgh seh^Kd In New Eng* 


land before 180>. New York, Macmillan Co. 


the 

X, 


An examination Into Xhp origin nnd iKilltlcnl. economic, nml social Influencea 
that brought the high school Into being In Now fe:nglnud. The study ascribes tba 
origin of Ihe high srhool to Aniorlran influonres. 

(2) Mlddlebrooka, John E. A history of the rise nnd fall of the academies 
In Tennessee. Master’s tliesls, George Peabody College for Teacherg, 
1923. 

Points out the important facts about the neademtes In Tonneiwre ; the purpose# 
for which they were rslnbllHhedf tholr means of support; tbelr plan of organisa- 
tion and administration; their cstablisipnont and dislrlbution ; and the causes 
for their decline. * 

(8) Stoddard, Jameg A. Backgi^und of secondary eduentioTi In South Caro- 
llTin. University of South Cnrollhn. Bulletin No. 150, November •!, 1924. 

A study from original sources of the development of secondnes education In 
'^Soutb Carolina. The colonial, post-ncvolutloiiary, post-Con(^eTV|f War, and 
post^onst ruction ‘^periods ars studied. ^ Wt 

(4) Stout, John B. The flevelopment of high sehool ciirricuta the NortJi 
Central States from 1860 to 1018. University of Chicago. Suppfementary 
Educational Monograph No. 15, 1021. * 
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f. Ar'xpfHfxefUnt 

(1) Brown, W. R., and \V»irthInpton. J. N. Suporvlsod .'study In Wisconsin high 

schools. School Ilevlp^v. .12 : (H)3-12, Oct(d)cr, 1»24. 

DosrrlbcR no cxpcriov'iit di'^lftnrd to HoiMin* olijcftlvp data on ilip rornimrntlvc 
mcrlta of aujH-rvlwd study and tlio clnHa rwltatlon plan. Interprets resiilta us 
favorable to Bupen-lned atinly. 

(2) Alderman* Grover H. Lecture method versus the question and answer 

method. Schwl Review, 80:20r>-0, March, 1022. 

l^rcsonts rpsults of iin ••xitcrlnirnt in an Iowa hlfili SchoolKshowliiie oompnnitlvp 
Tulues of le< turc nml (pn-Htton and-auawcr mnliud. I’liplla ranked in iiighi r 
- quartHe pn»fltpd uio«t by IcHun* muthod. 

(8) Blair, Vevia., and others. An experimental course in senior high school 
niatlienintics. ^Teachers College Itecord. 22; .104-414. Novcmlur. 1021. 

Outline*! nnd unolyzcn content of an exrK'ilmonliii courw in aciiior iiigh wiiooi 
mnthematiCM dcT!-iop<Ml in tlie Horace Miiiiii Rchooi. The olii and new courses In 
i^radu 10 wure run iinrallel and cnmpariNuni^ tnuilf*. 

(4) Branson, Kmest I‘. An cxiMTlmefit In arranging hlgh-scliool .sections on 
the basis of gfuerul ul.iUt.v. Journal of Kducatlonnl Hewirch, 3 : Tsl-.'). 
January, 1921. 

Muc liumireil piipllu In the elglitli grndca and two claHuea In th<- lileh hcIiodI 
of Long neiicli, fnltf., schools w.-re tcst<d with the Otis gr!iiip scale. Conclusion 
reached that tlie coiirw of study should ts- examined witli ilic needs t.f w.-uk 
^ clusHca Id m^d, nnd timi the grunting of credits and tlie aystcui of crodlt lKM>k- 

keeplng nnd progrom plniining shnuld lie made elastie. 

(6) Oates, Arthur I. A iiio*lern s.vsteinatlc versus an opixirtunistio metliod of 
teaching. TeacluTs College Record, 8: QTO-TOO, April, 1020. 

This study Is especially helpful tn thefdeRcilpilnn of methods uaed to secure 
two groui* that are eipil valent and In the frank statement of llrollHtions of n-sults 
found. 

S, Philonophicat 



(1) Cox, P. W. L. rurrlculiim ndjiistinenls in H(H!oiidary scdiools. Chni^tcra 

V-XIV. Pbllatlelphla. Lippincotr, 1925. 

Illustrntes a philosophical resenreh rhcck<>d by pmctlccs. 

(2) Guthrie. Edwin R. The paradoxes of Mr. Ru.ssell. Lancustcr.'’Pa., N»‘W 

Era Printing Co, 1915. . 

A study in the field of phlloHophy well llluHtrnting the mcthml. 

(3) Suhrie, Ambrose L. The iuductlye deterinination of educational method. 

Warwick & York, 191.5. 

( 4 ) Woplcs, Douglas. An approufli to the synllietlc stinl^of Interest In edu- 

cation. Warwick & York, 1921. 

L fiiirrcp 


(1) Almnck, John C., (nid Alni(u*k, Jiiincs L, AdininlHtrMtion problems con* 
iHHtetl wllli gifted children. Educational Administration and Super- 
vision, 8:, 129-410, March, 1922. 

A study of superior sttidents, Juniors and seniors, in high scbnola of Kiigehe, 
Oreg. Klfty-onc Mtuilcnis selected out of 726. Army alpha administered, followed 
by Otis group teat. Standard correlation between Army alpha and Otis was 
0.7JI5 (tmya) nnd 0.060 <girls). Eight per cent of grades 7 to 12 were found 
soperior. ('oncludea that It Is easier to discover these Individuals than to make 
/» satisfactory provision for them. 


(8) Dement, Altce L. Values In extra-curricnlar organizationB in the hfgh 
s«'h«>ol. School Review, 32 : 40-48, January, 1024. 


Presents data for 26 California high sclioola, sbowiuib tbo number of school 
orgnnlcaliona; the form of management onploycd; the purpose of bach orgauixa- 
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tlon;..!hc extent to wlHili pupliti pnrtlc!pnu»; the nccompllHhmriUH of the orgnnl- 
cations; the approxlmnte amount of time ^Iven to kcIohjI <irpuilzAtlona ; and Ihe 
ro 8 t of mrtlntalnlim tlu* orKaiil/.atloiio. 

(4) Eniiellianlt. N. L., ami tiiluTH, lU'port of the survey of the publlc school 

system of the t(»wii of Stamford, Conn. School year 1022-2.H. Tearhers 
Collejre, ColuuiI)la University. 

^ rimpterK of the rrtoot of InteicVt In seromlnry rd'irntlon nr.» : The teaching 
staff; secondary eihtmtlon; Kimlisli In the high scliool *, the teaching of mathe* 
nmtlcM: Indnstrlul arts; Ihio nrln; vocafinnid cdn»ntlon imi household arts cduca- 
Ihin; Americnnl/rttlnii claanes fur the foreign Ixiin; the preseiit school plant ;.tha 
city of Stamlord and Its sehooMulldlng prohlein ; the HcHtwl-bnlldlng program; 
school fiminclng and school cohIh In Stamford. ^ . 

(5) Monre. Harry H. Stntusj»f certain social studies In hig^ schools. Wash- 

incton. 1). C., Gmcnnnent rriiilin;; OfTicc, U>22. {V, H. lUireaii of Educa- 

tion. lUilletln. 11)22. No. 45. 

A sttidy hnH«'d on nn Imiiilry addressed to 13,0tU) high schools, Including all 
fuur yi'jir high k« IiooIh and some of the large two and throe year schools. More 
than O.lloO loporls were recelvwl. Data ctdleeltMl on number of schools offering 
the viirious cuiirsef*. ineliKKiH of presentlnc courses, enrollment In each, critlcismi, 
ete. Clvles, economies, sociology, current events, and iniHccIhiiicous conr.'ics are 
studlid -(j 

(C) Nortliwoj^t As.<i)cIatlon of Secondary nnd Higher Schools. Coimnlttoo rc- 
lK>rt. April 11. Ih2r>. Student mortality in secondary and higher schools 
of tlio Inland Empiro. 

Annlyzra dnt:i irnnx 10 tyi-ind nirdluin sized hluh kcIimoIs. with n total frcPh- 
man enn-ll»nei»t of lO.Mh’i piipils, for n four year period, and from 10 higher 
limtltiniofiK showing t< ndeiicies in elindnatlon. 

(7) St rnyiT, ‘George Di aytoii. and Haig. Robert Murray. Hie Hmmclng of 

(Mliication in the State of New York. Now York. Macmillan Co.. 1923. 
(Educational Finance Inqnlfy Coinmi.s.slon. rtihllcntlonH, vol. 1.) 

An 4 *xhaii^t Ivi' aniilyslM on H'e bnfll.s of Htallstical nmt^u'WlH of the nnanclal 
I)n.h!em of i‘d\u.nth»ii In the Stiilo of New^ York and resourcef for meeting tho 
program. ^ 

(8) Survey of tho Mlunds of 'AYilinington, Del. Part 2. Washlugtou, D. C., 

Government Printing Ofllee. 1921. (U. S. Buronu of Education. Bul- 

letin. 1921, No. 2.) 

ContalTiR chaphT on* FiTOiulioy education. St.itu'^ of KecOudary cMlueatlon ; two 
high FchoolH. one white, one colored; percentage Hchnol population In high 
Kehool; holding power; retardntlon and failures; cun IruhimK ; teacher-^ ; od- 
minlstrnllon and puporvlnlon ; hutldiiigs and equipment. • ^ ^ 

(9) Clement, John A., and Clement, J. II. Suinnmfy of organization and nd- 

ininistratlon of 40 junior hlgh-sehool sy.stenis of Kau.sas. Educational 
A\duilnlstratlon and Supervision, 8: 137-42, ;^lnrch, 1922. 

(IIVOB rcsulta of a qncBtlommlro study of Junior high schools of Kansas. PresentB 
data on school population: eiiroilmout. date and plan of organization; method of 
promotion; credit recording and claHsincutlon ut pupils; teaching periods per 
day; lenglh of recitation, and plan of Bupcrvlaeil study; exixnlcnco. truluing, and 
salary of teachers; boushig and control ^rc Introduced. 4 ^ 
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